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AESIEACT 

An instrument, developed in 1965 by Arthur Blumberg 
and Edmund Amidon to measure te?»cher perceptions of supervisory 
conferences, has presented problems of reliability ^to researchers. 
The problem has stemmed from the lack of a valid and reliable scoring 
method for the. instrument. The instrument was administered to 31 
in-service teachers. Grades K-12, randomly selected from a larger 
group involved in a program of supervision. The data were subjected 
to factor analysis and subsequent alpha internal reliability 
estimates. It was found that the Blumberg-Amidon instrument is a 
two-factor or two^scale measure «hich may also be interpreted as a 
one-scale measure, each with a high degree of reliability. The 
instrument is important and valuable to the study of educational 
supervision and its optional scoring methods render it extremely 
flexible over a wide range of research interests and needs. The 
instrument is included. (Author/MV). 
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A Paotor-Analytic Validity Study of the Blumberg- 
Amidon "Teacher Perceptions of Supervisor- 
Teacher Conferences" Instrument (VAR) 
HERMAN A. SIROIS ROBEKT K. GABLE 

University of Connecticut 

ABSTRACT 

Problem. An instrument, developed in 1965 by Arthur Blumberg 
and Edmund Amidon to measure teeusher perceptions of supervisory con- 
ferences, has presented problems of reliability to researchers* The 
problem hsus stemmed from the lack of a valid and reliable scoring 
method for the instrument. 

Methodology * The instrument was administered to thirty-one 
inservice teachers, grades K-12, randomly selected from a larger group 
involved in a program of supervision. The data were subjected to fac- 

i 

tor analysis and subsequent alpha internal reliability estimates. 

Results . It was found that the Blumberg-Amidon instrument is 
a two-factor or two-scale mefisure which may also be interpreted as a 
one-scale measurei each with a hi^ degree of reliability. 

Conclusions . It is concluded that the instrument is important 
and valuable to the study of educational supervision and* that its 
optional scoring methods render it extremely flexible over a wide 
reinge of research interests and needs. 
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A Factor-Analytic Validity Study of the 
Blumberg-Amidon "Teacher Perceptions 
• of Supervisor-Teacher Conferences" Instrument 

Herman A, Sirois Robert Ke Gable 

University of Connecticut 

The effectiveness of supervisory conference in educa- 
tion and the identification of significant supervisor- 
teacher correlates associated with such effectiveness have 
"been the subject of a growing amouttit of research in the 
last decade (Bltunberg & Amidorxs Blumberg & others, 

1968, 19701 Weller, 1971 J Barber, 1972| others),.^ One of 
the persistent obstacles to such research has been the 
lack of reliable instnaments with which to measure the 
effectiveness of supervisory conferences and/or the nature 
of the supervisor- teacher indei|ident variables t 

In a 1965 publication, Arthur Blumberg and Edmund . 
Amidon tackled both of these problems, that is, the measure 
ment of both the dependent and independent variables rela- 
ted to supervisory conferences in education (Blumberg & 
Amidon, 1965)» At that time, they offered a two part 
instriunent, the first part of which sought to determine the 
nature of the supervisor's behavior (the proposed indepen- 
dent variable) as directive or non-directive a la Carl 



Rogers (196I). 

The second part of this instrument, which is the 
subject of the. present analysis, sought to determine the 
effectiveness of supervisory Conferences as perceived by 
the teacher. This scale, which Bliimberg, Amidori, and 
others have used as a criterion measure in several studies t 
consists of twelve steins and is reproduce in Figvire 1 (from 
Blumberg & Amidon, 19^5)^ 

Insert Figure 1 

Host of the items in this scale were derived by Blum- 
berg and Amidon from Gibb's (1961) work on defensive com- 
munication t while other items "about the nature of a tea- 
cher's' learning from supervision and an item on the teacher's 
general feelings about the productivity of his interaction 
with his supervisor were also included (Blxjimberg, .I97^f p. ^5)- 

In presenting this instrument, Blxamberg & Amidon (I965) 
failed to cite or establish its reliability > nor, to the 
best of our knov/ledge, has such reliability been subsequently 
established. The authors (Blumberg & Amidon, I965) proceed 
in this and subseq[uent studies (e.g. Blumberg, 1974) with 
the questionable, procedure of analyzing the data on the 
basis of each separate stem or by intuitive clusters of 
these stems* 
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Research based on such procedures is, of course, 
Buboect to question. Moreover, the lack of established 
reliability for an otherwise promising instrument can 
present problems for researchers who seek to analyze the 
constructs underlying such a scale, A further problem, 
closely related to that of reliability,^ has been the lack 
of directions for scoring the instrument. It is these 
concerns which precipitated the present validation study, - 

Methodolo^ 

The Blxamberg-Amidon "Teacher Perceptions of Supervisory 
Conferences" instrument, part two (see Figure 1), was ad- 
ministered to 31 in-service teachers, grades K-.12, in a ^ 
small Connecticut city with a student population of about 
10,000» These teachers were Selected randomly and repre- 
,sented varying degrees of involvement in a systematic 
program of teacher supervisiona''' 

The subjects were asked to describe the supervisory 
conferences they had had with their supervisors on a scale 
of one (l=low) to five (5=high) for each of the twelve stems 
The resulting data were subjected to factor analysis to 
determine appropriate factor loadings and also to determine 
the proper scoring procedures (if any) for the scale (s). 
An alpha internal reliability analysis was performed to 
determine; the reliability of the resultant scale (s). 



Results 

The means and standard deviations of the sample for 
each stem are reported in '-Cable It 

Insert Table 1 

The incomplete com]^ents loading matrix of the factor 

analysis revealed three factors for the data. Table 2 

reports the inter correlations of the primary axes of the 

three factors resulting from the analysis* 

— — — — — \ 
Insert Table 2 

Table 2 reveals , that factors one and two are highly 
related to each other (.71) and, therefore, are not or- 
thogonal. Consequently, it v/as decided that the obliquimax 
rotation of factors would be used for any further analyses. 
Table 3 presents the obliquimax factor loadings of each of 
the three factors for each of the twelve stems. 

Insert Table 3 

Inspection of the factor loadings reported in Table 3 
reveal two factors which imderlie the Blumberg-Amidon 
instrument. Loadings on factor one include stems 1, i*-, 5f 
6, and 7 s v/hile factor two loadings include stems 2, 3, 8, 
9, 10, and 12. Stem eleven is isolated on factor three* 

Before turning to testing the reliability of these tv;o 
factors, we recall from Table 2 that factors one and two 
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are highly related to each other (.?!). This presents u3 
v/ith an interesting dilemma, namely, a two-scale instrument 
which may possibly be interpreted as a one-scale instrument, 

v/ith this possibility in mind, it-v/as decided to test 
for reliability in two ways: first, to test for the relia- 
bility of each of the two scales (factors) with stems entered 
appropriately on each scale j and second, to test for the 
reliability of a one scale instrument with stems from factors 
one and tv/o combined. .The results of these alpha internal 
reliability analyses ai*e* reported in the right hand column 
of Table 4. 

rjamin^ and Soorin^ the Scales 

Table 4 confirms our suspicion that the Blumberg-Amidon 
instrument may be scored and interpreted in at least tv/o' 
ways: as a tvro-scale instrxiraent and/or as a one-scale in- 
strument . Such interpretations, of course, are dependent 
upon the constructs which underlie the instrument and its 
scales and the research interests of the users.- 

Scale R of the instrument, which we have named "Rela- 
tionships", consists of stems 1, 4, 5, 6, and ? of factor 
one. Scale R appears to be based on the constructs of the 
interpersonal climate of the supervisory conferences and of 
the teacher's relationship v/ith the supervisor. 



8 



Scale P of the instrument, which we have named "Pro-- 
ductivity", consists of stems 2, 3, 8, 9, 10, and 12 of 
factor two, and appears to have as its underlying constructs 
the teacher's perception of the learning and productivity 
resulting from supervisory conferences » Table -4- itemizes 
the stems associated with each scale. The reliability of 
scale R is estimated at ,91, while scale P is estimated for 
reliability at .88, ■ : - 

Insert Table S 

As a one-scale instrument, with scales R and P combined, 
a reliability of .92 is estimated for the Blumberg-Amidon 
instrument. All stems, \vith the. exclusion of ntmiber eleven, 
are included when scoring this instrumient as a one-scale 
measure (, 

Scoring data in relation to these scales is simple. 
A subject ^s ratings on the stems associated with the scale (s) 
\mder cons iderat ion (scale Ry or F^'^b^^^^^ plus P if the one- 
scale method is used) are simply totaled to yield a scor*e 

which may be compared to other subjects. The only .pre.cau- 

tion is that stems ^, 5> 6, 7$ 9$ and 12 must be reverse 
scored prior to such totaling; 

The researcher's interests and hypotheses should, of 
course, direct the choice of scales and^'their use in any 
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situation. The potential for using this instriMent as a 
two-scale or one-scale measure is not merely an exercise 
in statistical semanticst Iff for example ^ as a result of 
training emd implementation of a certain program of teacher 
supervision, it is hypothesized that supervisor- teacher 
relationships may change, then scale R from the two-scale 
"version" of this instrument could appropriatley te util- 
izedt If, in addition, it is hypothesized that teachers* 
perceptions of the productivity of supervision will change 
as a result of the treatment suggested at)ove, then both 
the R and P scales of the tv/o-scale version would apply as 
two separate criterion measures* 

If, on the other hand, hypotheses caiinot be so speci- 
fically stated, or change is hypothesized to occur in a 
less than systematic manner (cf above), or if "fhe general 
nature of the supervisory relationship and its effectiveness 
(at least as perceived by teachers) is recLuired as an inde- 
pendent variable , then* the nAse 
raent as a one-scale measure may be advised^ 

— Conclusions — . 

Based on the present analysis, it is clear that Blum- 
berg and Amidon (I965) have developed an instrument that 
can be valuable in the study of educational supervision. 
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V/hat is equally clear, however, is that this instrument has 
not been adequately analyzed, and that any conclusions 
based on its use (at least to date) are questionable • 

The problem has stemmed from the lack of a valid and 
reliable scoring method for the instrument? a problem which 
this report seeks to remediate* The . method employed was a 
factor analysis of the instrument and subsequent alpha 
internal reliability estimates of resulting factors • 

It was found that the Blumberg-Amidon "Teacher Percep- 
tions of Supervisory Conferences" instrument is a two- 
factor or tv7o- scale measin^e which may also be interpreted 
as a one-scale measure, each v/ith a high degree of relia- 
bilityV It is also concluded that such pptior^^-. scoring 
methods for this instrument render it extremely flexible 
and valuable over a wide range of res e^^ and 
needs 

Finally, researchers are advised to make use of the 
Biumberg-Amidon instrument with confidence in its relia- 
bility if sc bring' pr^^^ 

followed* The instrument, in its brevity, achieves a degree 
of parsimony not often fouad in instruraents of this type* 
It contains only tv/elve stems and scoring is relatively 
simple. Further, the constructs underlying the instrument 
are clear, significant, and practical in terms of the 
realities of the practice of educational supervision • 



Figure 1 



Bl-uinberg-ATnidon "Teacher Perceptions 
of Supervisor-Teacher Conferences" 



It Teacher freedom to initiate 1 2 

discussion. 

2 • Learning about one • s behavior 1 2 

as a teacherf . ' 

3t Learning about oneself as a 12 
person© 

Supervisor's perceived need 1 2 

to control. ~ ~ 

5« (strategy) Teacher's felt^need 1 2 

to plan his behavior to avoid 
certain areas of discussion. 

6. Supervisor's perceived attitude 1 2 
of superiority* 

7. (Certaintly) Perceived tendency 1 2 
of supervisor to assume he has 

the right answers , 

8. Perceived empathy by the 1 2 
supervisor. 

9» Feeling of being evaluated 1 2 

by the supervisor. 

10. Perceptions of productivity 1 2 
by supervisory conferences. 

11. Perceived amount of supervisor 1 2 
talk. 



12. Discrepancy betv;een perceived 1 : 2 

and "wished for" supervisor 
behavior. 3^^^ 



^ ■ ■ 
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Table 1 

Means and' Standard Deviations of 
the Sample for Each Stem of the 
Blumberg-Amidon Instrument 
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2,90 
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2,32 






1.97 


1.20 


6 


1.87 


1,02 
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2.23 


1,15 


8 


3.55 


1.12 
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2,61 


1.20 


10 


3.7^ 


1.2/j. 
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3.^5 
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12 


2,61 


1.^5 
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Table 2 

Intercorrelation of Primary Axou 



1 1,00 0.71 -0,3^ 

2 1.00 -0.2ilf 

3 1.00 
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Table 3 



Obliquimax Factor Loadings Matrix 





1 


2 


3 


1 




mmm 


— 


2 


— 


92 


— 


3 




86 






-98 






5 


-10^4- 






6 


-72 






7 


-98 


• 




8 




65 




9 


60 


-88 


53 


10 




71 




11 






89 


12 - 




^8if 





Note: the original matrix v/as 
rouhded to' W and mul- 

tiplied by 100 for this table i 
only values over ^0 are repor- 
ted. 
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Tat>le ^ 

Beliability Estimates and Scoring Procedures 
for the Scales of the Bluraberg-Amidon "Teacher • 
Perceptions of Supervisory Conferences" Instrument 

"Alpha 

Reliability 

_ . Estimate 
It As a two-scale instrument: 

A. Scale R, Relationships (Factor One) ,91 

1. Ten ' frv ^lom to initiate discussion. 
Supfc. auor's perceived need to control. 

*5. (Strategy) Teacher's felt need to plan 

- -•- — • ' his-behavior to avoid -certain""areas of" » " 

discussion. 

*6. Supervisor's perceived attitude of super- • ■ 
lority. 

*7# (Certainty) Perceived tendency of super- 
visor to assume he has the right an- 
swers t 

B. Scale P, Productivity (Factor Two) .88 

2. Learning abouli one's behavior as a 

teacher t 

3t LeariEBng about oneself as a persont 
8. Perc^/&ved empathy by the supervisor. 
'^9* Feeling of being evaluated by the sup^-. 
visasr • 

10. Perceptions of produ-etivity by supervSl. 
sary conferences* 
■^12 • Discrepancy between perceived and 

"wished for" supervisor behavior. ~ 

II. As a one-scale instrument j 

(Factors One and T^vo combined) Productivity and .92 
Relationships of Supervisory Conferences 

(Include all istems except number eleven.) 



•^Reverse :sco2^ ^ese stems. 
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Reference Notes 

!• Establishing the extent , to v/hich supervision has - 

actually occurred (if not as a continuous variable > 
at least categorically) is most important, and often 
overlooked. As Weller (1971 » PP.» 29-30) points out, 
the problem of insignificant results which seems to 
plauge research in educational supervision may be 
largely due to the failiire of researchers to determine 
the extent to which (if at all) a particular iT?odel of 
supervision has actually be6n implemented or adhered 
to during a particular study. In test construction, 
this caution seems to suffer even greater violations, 
if not complete disregard. There seems to exist the 
assumption that all public school teachers receive or 
arc involved in supervisory conferences with their * 
supervisors, and can, therefore, reliably describe 
the nature of the supervisory process. The develop- 
ment of research instruments based on this assiunption 
is obviously ill-advised but not uncommon. .The 
present study did not make this assumption. 
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SUMMARY 



Problem 



. The problem of teacher supervision, althou^ long neglected in educational re- 
search, is becoming increasingly important as demands for educational accountability 
and consequent state and locally mandated teacher evaluation programs increase. The 
effectiveness of supervisory conferences in education and the identification of signi- 
ficant supervisor-teacher correlates associated with such effectiveness have been 
subject of a growing amount of research in the last decade (Blumberg & Aroidon, 19655 
Blumberg-& others, 1968, 197O; Weller, 1971; Barber, 1972; others). One of the per- 
sistent obstacles to such research has been the lack of reliable instruments- with vrtiich 
to measuxe either the effectiveness of supervisory conferences and/or the nature of the 
supervisor-teacher independent variables, 

Th a 1965 pub li cation, Arthur fBHiumberg and Edmund Amidon tackled both of these 
problems, offering' researjchers a two part instrument , the first part of vdiich sou^t to 
measure certain supervisor^behaviors as an indespendent- variable, while the second part 
of this instrument (the subject of the present ^analysis) sou^t to determine 1±ie effec- 
tiveness of supervisory co:nferences (the suggested dependent; variable) as perceived by 
the teacher (Blumberg & Amidon, 1965)« 

In presenting this: instrument,,' Blumberg and Araidon (1965) failed to cite or 
establish its reiiability, nor, to ther:beBt of our knowledge, has such reliability been 
subsequently established. The presentisatudy seeks to establish such reliability and 
to present directions for scoring the ^instrument. 



Instrumentation , Sample , The Biumberg-Amidon "Teacher Perceptions of Supers 
visory Conferences" instrument (part two, Blumberg. <fe Amidon, 1965) was administered to 
31 in-service* teachers, grades K-12, These teachers were selected randomly and repre- 
sented varying degrees of involvement in a systematic program of teacher supervision. 

Analysis , The subjects were asked to describe the supervisory conferences they 
had had with their: supervisors using the twelve stems of the Blumberg-Amidon instrument. 
The resulting data were subjected to factor analysis to deteimine appropriate factor 
loadings and also to determine the proper scoring; procedures (if any) for the scale(s). 
An alpha-internal reliability analysis was performed to deteimine tie reliability of 
each of the resultant scales. 



The rotated 3kctor loadings (obliquimax) revealed that the.cBlumberg-Araidon instru- 
ment consists of tiaBo factors or scales. Factor one, which we have named "Relationships," 
deals witth the teactor* s perceptions of the^.^^i relationships .between the^teachr 

er and the superviBoar, Factor two, which we have nsmed "Productivity ," deals with the 
teacher's perceptions of the learning and usefulnesB resulting from the supervisory con- 
ferences. These ^^tato factors should be named Scale ® and Scale P, ;respectively, Scale R 



Methodology 



Results 
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is estimated for reliability at •91t while the reliability of Scale P is estimated at .SS. 

The two scalesi further, are highly correlated to each other (at 71 Thus, it 
is possible to consider the instrument as a ons'-scale insLllunesvt* u v^iidrscale test, 
the Blumberg-Amidon instrument would be a measure of the productive relationships of 
•iaipesmdory coitferesees as iperceived by teachers. As a one-sc£Lle instrument , with 
scaSes R and P combined y a :reliability of m92 is estimated* 

Conclusions 

The researcher's interest and hypothesis should,, of course, direct the choice of 
scales and their use in any situation* .'ffie^:^potential for using this instrument as a 
two'T^ipale or 6ne->scaleHnneasure is not mezas^y an exercise in statistical semantics* If, 
for example, as a result of training in :aiL implementation of a. certain pi^Dgrfiun ^^^ 
supervision, it is hypothesized that the^superviaor-teacher relationshipis may change, 
tixen Scale R from the :^wo->scale version o£ this instrument could appzH)priately be utilised 
laicBHise, the P scale^aiay be utilized to:^st the hypothesis that teacher perceptions of 
productivity of superviBory conferences i^ a result of the treatment suggested 

If, on the octher hand, hypothesesi caxmot be so specifically stated, or change is 
hypothesized to occur in: a less than sys^emstic manner (of above)-, or if the general 
nature of the super:visory relationship and:J:ts effectiveness is required as an indepen'-* 
dent 'variable, then the use of the Blumberg^'i^idon instrument as a one-acale measure is 
advised* 

Researchers ar3 .advised to make use rof the instrument with confidence in its 
reliability (vdien scored . as per directions)* The instrument, in its brevity, achieves 
a degree of peursimony not::of ten found in instruments of this type* It contains only 
twelve stems emd scoring:33 relatively simple* Finally, the constructs imderlying the 
instrument are clear, srgn±ficant, and practical in terms of the realities of educational 
supervision* 



